Sensory Attention : Computational Sensor Paradigm for Low – Latency Adaptive Vision
نویسندگان
چکیده
1 The need for robust self–contained and low-latency vision systems is growing: high speed visual servo-ing and vision–based human computer interface. Conventional vision systems can hardly meet this need because 1) the latency is incurred in a data transfer and computational bottlenecks, and 2) there is no top–down feedback to adapt sensor performance for improved robustness. In this paper we present a tracking computational sensor — a VLSI implementation of a sensory attention. The tracking sensor focuses attention on a salient feature in its receptive field and maintains this attention in the world coordinates. Using both low –latency massive parallel processing and top–down sensory adaptation, the sensor reliably tracks features of interest while it suppresses other irrelevant features that may interfere with the task at hand.
منابع مشابه
Computational Sensors for Global Operations in Vision
The performance of existing machine vision systems still significantly lags that of a biological vision. The two most critical features presently missing from the machine vision are low latency processing and toppdow1z sensory aduptation. This thesis proposes to overcome these two deficiencies by implementing global operations in computational sensors. Computational se.nsors incorporate computa...
متن کاملIntegrated Vision and Sensing for Human Sensory Augmentation
The Carnegie Mellon University MURI project sponsored by ONR performs multi-disciplinary research in integrating vision algorithms with sensing technology for low-power, low-latency, compact adaptive vision systems. These are crucial features necessary for augmenting the human sensory system and enabling sensory driven information delivery. The project spans four subareas ranging from low to hi...
متن کاملA VLSI sorting image sensor: global massively parallel intensity-to-time processing for low-latency adaptive vision
This paper presents a new intensity–to–time processing paradigm suitable for VLSI computational sensor implementation of global operations over sensed images. Global image quantities usually describe images with fewer data. When computed at the point of sensing, global quantities result in a low– latency performance due to the reduced data transfer requirements between an image sensor and a pro...
متن کاملA sorting image sensor: an example of massively parallel intensity-to-time processing for low-latency computational sensors
The need for low-latency vision systems is growing: high speed visual servoing and vision–based human computer interface. In this paper we present a new intensity–to–time processing paradigm suitable for low–latency massively parallel global computation over fine–grained data such as images. As an example of a low–latency global computation, we have developed a VLSI sorting computational sensor...
متن کاملComputational Sensor for Visual Tracking with Attention
This paper presents a VLSI embodiment of an optical tracking computational sensor which focuses attention on a salient target in its field of view. Using both low-latency massive parallel processing and top-down sensory adaptation, the sensor suppresses interference from features irrelevant for the task at hand, and tracks a target of interest at speeds of up to 7000 pixels/s. The sensor locks ...
متن کاملذخیره در منابع من
با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید
عنوان ژورنال:
دوره شماره
صفحات -
تاریخ انتشار 2007